Gå til hovedinnhold

Evaluation

Evaluation is one of the most important aspects of machine learning development. It is the craft of understanding the model and how it works.

Cooks Distance

Cook's distance is used to determine the influence each data point has on the fitted model. In other words, it tells you how much the predictions from your model would change if you excluded certain observations. A large Cook's distance for a particular point means that this point has a substantial influence on the model. This could be because it's an outlier or a highly leveraged point.

Shapely

Shapely is a framework for evaluating machine learning models.

Confident Learning

Confident learning can if not evaluate the model, then at least it can evaluate the data.

Links

Thoughts

  • The more complex the model, the more difficult it will be to evaluate.